Color-Based Visual Servoing of a Mobile Manipulator with Stereo Vision
نویسندگان
چکیده
In this study, stereo vision system is applied to visual servoing of a mobile manipulator. The robot can recognize a target and compute the 3D position of the target by using a stereo vision system. A stereo vision system enables the robot to find the position of a target without additional information while a monocular vision system needs properties such as geometric shape of a target. Many algorithms have been studied and developed for object recognition. However, most of these approaches have a disadvantage of the complexity of computations and they are inadequate for real-time visual servoing. The other hand color information is useful for simple recognition in real-time visual servoing. In this paper, we refer to object recognition using colors, stereo matching method, recovery of 3D space, and the visual servoing.
منابع مشابه
The UJI librarian robot
This paper describes the UJI Librarian Robot, a mobile manipulator that is able to autonomously locate a book in an ordinary library, and grasp it from a bookshelf, by using eye-in-hand stereo vision and force sensing. The robot is only provided with the book code, a library map and some knowledge about its logical structure and takes advantage of the spatio-temporal constraints and regularitie...
متن کاملAn Acceleration Command Approach to Robotic Stereo Image-based Visual Servoing
This paper presents a new stereo image-based visual servoing (IBVS) controller for a six degrees of freedom (DOF) robot manipulator based on acceleration command. An eye-in-hand stereo vision system is utilized to capture the images of the object and to estimate the depth of the object. A proportional derivative (PD) controller is developed considering the acceleration command. The augmented im...
متن کاملAn Intelligent Vision System on a Mobile Manipulator
This article will introduce a robust vision system which was implemented on a mobile manipulator. This robot has to find objects and deliver them to pre specified locations. In the first stage, a method which is named color adjacency method was employed. However, this method needs a large amount of memory and the process is very slow on computers with small memories. Therefore since the previou...
متن کاملA Study on Visual Feedback Control of a Dual Arm Robot with Eight Joints
Visual servoing is the fusion of results from many elemental areas including high-speed image processing, kinematics, dynamics, control theory, and real-time computing. It has much in common with research into active vision and structure from motion, but is quite different from the often described use of vision in hierarchical task-level robot control systems. We present a new approach to visua...
متن کاملSurvey of vision-based robot control
In this paper, a short survey of vision-based robot control (generally called visual servoing) is presented. Visual servoing concerns several field of research including vision systems, robotics and automatic control. Visual servoing can be useful for a wide range of applications and it can be used to control many different dynamic systems (manipulator arms, mobile robots, aircraft, etc.). Visu...
متن کامل